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Description 

[0001] The present invention relates to a system for 
analyzing the action of, e.g. ; a user who is carrying a 
portable terminal on the basis of information acquired 
from the portable terminal. 

[0002] Information representing the date/time and po- 
sition of a visit, and in some cases, information of a 
transport facility used need often be recorded as a daily 
action record. 

[0003] In such a case, the user makes a note on the 
self action in a pocketbook orthe like, or inputs the daily 
action to a personal computer or the like after he/she 
goes back to the office. In recent years, a portable ter- 
minal is becoming popular, and instead of writing the ac- 
tion in the pocketbook, the action record may be some- 
times input to the portable terminal. 
[0004] The operation of writing the daily action record 
in the pocketbook or inputting it to the personal compu- 
ter is cumbersome. In addition, the writing or data input 
operation is often forgotten, so no accurate action 
record can be made. 

[0005] US-A-4,750,197 describes a security system 
for cargo transportation containers. The described se- 
curity system is provided inside of containers and com- 
prises a plurality of devices and sensors, e.g. a door 
sensor, a light-level sensor, a real-time clock, a distance 
unit. During the duration of a transportation, data relat- 
ing to events occurring are collected and stored in a 
memory unit. Upon completion of a transportation, the 
memory is removed and the stored data are analyzed 
in order to calculate a roadmap of the travel route. In 
addition, a radio link may be provided in orderto transmit 
an alarm message including position information to a 
central monitoring facility. 

[0006] EP-A2-0 720 137 relates to a traffic information 
system. The traffic information system comprises a plu- 
rality of on-vehicle apparatus and a center apparatus. 
Each on-vehicle apparatus collects traffic information as 
traffic jam information, weather information and position 
information. Together with time data, the collected infor- 
mation is transmitted from an on-vehicle apparatus to 
the center apparatus. The center apparatus collects the 
information from a plurality of vehicles and creates in- 
formation relating to a region based on the received da- 
ta. 

[0007] It is the object of the present invention to pro- 
vide an improved action analyzing/recording system for 
automatically analyzing outdoor information. 
[0008] This is achieved by the features of claim 1 . 
[0009] According to the present invention, the action 
of the user who is holding the terminal outdoors can be 
analyzed, and the means of transportation can be esti- 
mated. Therefore, an accurate action can be automati- 
cally input without requiring the user of any specific input 
operation. In addition, since the analyzed data is record- 
ed, the data can be referred to later as a personal action 
record or record in a goods delivery operation and ap- 



plied to various application purposes. 
[0010] This invention can be more fully understood 
from the following detailed description when taken in 
conjunction with the accompanying drawings, in which: 

FIG. 1 is a view showing the system configuration 
of an embodiment; 

FIG. 2 is a perspective view showing the outer ap- 
pearance of a portable terminal; 
FIG. 3 is a block diagram of the portable terminal; 
FIG. 4 is a view showing the structure of a packet 
sent from the portable terminal; 
FIG. 5 is a flow chart of an operation of preparing a 
packet from data acquired by the portable terminal 
and sending the packet; 

FIG. 6 is a block diagram showing the arrangement 
of a host terminal; 

FIG. 7 is a flow chart for explaining processing in 
the host terminal; 

FIG. 8 is a view showing an example of the moving 
route of a user who is carrying the portableterminal; 
FIG. 9 is a view showing an example of map data 
stored in the host terminal; 

FIG. 10 is a flow chart (1) of processing of estimat- 
ing the action of the user who is carrying the porta- 
ble terminal; 

FIG. 11 is a flow chart (2) of processing of estimating 
the action of the user who is carrying the portable 
terminal; 

FIG. 12 is a flow chart (3) of processing of estimat- 
ing the action of the user who is carrying the porta- 
ble terminal; 

FIG. 13 is a view showing an example of the result 

obtained by estimating the action of the user who is 

carrying the portable terminal; 

FIG. 14 is a view showing an example of an action 

record table of the user who is carrying the portable 

terminal; 

FIG. 15 is a flow chart of processing of preparing 
the action record table of the user who is carrying 
the portable terminal; 

FIG. 16 is a table which stores names on a map and 

corresponding position information; 

FIG. 17 is a flow chart of an operation of preparing 

apacketfrom data acquired by the portableterminal 

and sending the packet; and 

FIG. 18 is a view illustrating the action record of the 

user who is carrying the portable terminal. 

[0011] The embodiment of the present invention will 
be described below with reference to the accompanying 
drawing. 

[0012] FIG. 1 is a view showing the system configu- 
ration of this embodiment. In this embodiment, a system 
for analyzing the action of a user having a portable ter- 
minal 1 in a hostterminal (server machine) 3 accommo- 
dated in a public network 2 will be described. Assume 
that the user is always carrying the portable terminal 1 . 



10 



15 



20 



25 



30 



35 



40 



45 



50 



2 



3 



EP 0 834 840 B1 



4 



[0013] The portable terminal 1 detects the position (e. 
g., aa°bb' north and cc°dd' east) of the portable terminal 
1 at a certain time point and this time autonomously or 
in accordance with an instruction from the portable ter- 
minal 1 and supplies the position and time information 
to the host terminal 3. At this time, the portable terminal 

I is connected to the public network 2 through the near- 
est base station 4. Upon being notified of the position 
and time, the host terminal 3 recognizes the position of 
the user who is carrying the portable terminal 1 at the 
certain time. 

[0014] The portable terminal 1 supplies the informa- 
tion (position information and time information) to the 
host terminal 3 at every predetermined timing. The host 
terminal 3 analyzes the time-serially detected informa- 
tion, thereby recognizingthe moving locus and the mov- 
ing speed of the user of the portable terminal 1 . 
[0015] Each portable terminal 1 having a particular 
terminal identification code. Data detected by a portable 
terminal 1 are stored in correspondence with the termi- 
nal identification code and are transmitted together with 
said terminal identification code to the host terminal 3. 
[001 6] FIG. 2 is a perspective view showing the outer 
appearance of the portable terminal 1 . The portable ter- 
minal 1 has an LCD display unit 11, a microphone 12, 
and a general-purpose IF connector 13. A GPS (Global 
Positioning System) sensor 14 is connected to the gen- 
eral-purpose IF connector 13. The portable terminal 1 
has a radio communication antenna 15. 
[001 7] FIG. 3 is a block diagram of the portable termi- 
nal 1 . A CPU 21 executes a program stored in a storage 
unit 22 (ROM and RAM). The CPU 21 and the storage 
unit 22 are connected via a bus 23. 
[0018] The storage unit 22 is constituted by a semi- 
conductor memory, a magnetic recording medium, or an 
optical recording medium and stores the program, data, 
and the like. The storage unit 22 may be permanently 
incorporated or detachably mounted in the portable ter- 
minal 1 . 

[0019] A recording medium driver 24 is connected to 
the bus 23 to read out data stored in a portable recording 
medium (including a semiconductor memory, a magnet- 
ic disk, an optical disk, and a magnetooptical disk) 25 
or write data in the portable recording medium 25. An 
IC card is assumed as an example of the portable re- 
cording medium 25. The CPU 21 can also execute a 
program stored in the portable recording medium 25. 
[0020] The program and data to be recorded in the 
storage unit 22 may be received from another device 
connected through a communication line or the like, and 
recorded. Alternatively, the CPU 21 may use, through 
the communication line or the like, a program and data 
stored in a storage unit arranged on the another device 
side. 

[0021] A unit corresponding to the LCD display unit 

II comprises a liquid crystal display (LCD) 31 , a mem- 
ory 32 for storing information to be displayed on the liq- 
uid crystal display 31 , an LCD driver 33 for outputting 



information stored in the memory 32 to the liquid crystal 
display 31 under the control of an LCD control unit 34, 
and the LCD control unit 34 for controlling the memory 
32 and the LCD driver 33. 

5 [0022] An A/D converter 35 converts sound informa- 
tion acquired through the microphone 1 2 into digital da- 
ta. A sound information control unit36 outputs the sound 
information A/D-converted by the A/D converter 35 to 
the bus 23. The sound information control unit 36 has a 

10 function of compressing sound information. 

[0023] The GPS sensor 14 detects the current posi- 
tion by communicating with, e.g. , an artificial satellite. A 
general-purpose IF unit 37 outputs detected data from 
the GPS sensor 1 4 to the bus 23 in accordance with an 

15 instruction from the CPU 21 . A timepiece 38 counts time. 
A timer 39 interrupts the CPU 21 at a predetermined 
time interval. 

[0024] In sending data, a communication control unit 
40 prepares a transmission packet and transfers the 

20 packet to a radio transceiver 41 in accordance with an 
instruction from the CPU 21 . In receiving data, the com- 
munication control unit 40 outputs data stored in a pack- 
et received through the radio transceiver 41 onto the bus 
23. The radio transceiver 41 is connected to the radio 

25 communication antenna 15 shown in FIG. 2 to transmit/ 
receive data to/from the base station 4. 
[0025] FIG. 4 is a view showing the structure of a 
packet sent from the portable terminal 1 . Each packet 
is constituted by a header portion and a data portion. 

30 The header portion stores a transmission source ad- 
dress, a transmission destination address, and the like. 
The address system containing an address to be stored 
as a transmission source address or atransmission des- 
tination address is determined depending on the net- 

35 work structure to which this embodiment is applied. In, 
e.g., TCP/IP communication, an IP address is stored. 
[0026] The data portion stores application identifica- 
tion information, a command, position information, time 
information, and sound information. The application 

40 identification information is used to identify an applica- 
tion program to be started on a destination terminal (host 
terminal 3 in this embodiment). In this embodiment, in- 
formation for identifying an action analysis program is 
set. Note that, in TCP/IP communication, the application 

45 identification information is designated as a port 
number. 

[0027] The command is instruction information for the 
terminal (host terminal 3) designated by the transmis- 
sion destination address and is interpreted on an appli- 

50 cation designated by application identification informa- 
tion. In this embodiment, an action analysis command 
or an analysis result request command is used. 
[0028] The position information represents the posi- 
tion of the portable terminal 1 and corresponds to the 

55 position of the userwho is carrying the portable terminal. 
This position information is sequentially prepared on the 
basis of the output from the GPS sensor 14. The time 
information represents time when the position informa- 
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tion, i.e., the output from the GPS sensor 1 4 is detected, 
and corresponds to the output from the timepiece 38. 
The sound information is sound data acquired through 
the microphone 1 2 at the timing when the position infor- 
mation is detected. In this embodiment, sound informa- 
tion is acquired as ambient information of the portable 
terminal 1 . However, a temperature sensor or a camera 
may be arranged to acquire temperature or-image infor- 
mation as ambient information. 

[0029] FIG. 5 is a flow chart of an operation of prepar- 
ing a packet from data acquired by the portable terminal 
and sending the packet. The program for realizing the 
functions of this flow chart is stored in the storage unit 
22 as a form of program code which can be read by the 
CPU 21 . In this processing, the portable terminal 1 ac- 
quires position information, time information, and sound 
information N times at a predetermined time interval, 
transfers all the acquired information to the hostterminal 
3, and requests action analysis processing. Assume 
that the portable terminal 1 is always executing the pro- 
gram for acquiring position information, time informa- 
tion, and sound information while the power is ON. 
[0030] In steps S1 and S2, predetermined time inter- 
val data is set for the timer 39, and the timer 39 is started. 
When the timer 39 has counted a predetermined time 
(e.g., one minute), an interrupt signal is input to the CPU 
21 via the bus 23, so that processing from step S3 is 
executed. 

[0031] In step S3, the output (position information) 
from the GPS sensor 1 4 is acquired. In step S4, the time 
(time information) counted by the timepiece 38 is ac- 
quired. In step S5, the timer 39 is reset. In step S6, am- 
bient sound data (e.g., noise) collected through the mi- 
crophone 12 is acquired. This sound collection process- 
ing is performed for, e.g., 5 seconds. The timer 39 is 
reset and starts the time counting operation again. 
[0032] In step S7, the information acquired in steps 
S3, S4, and S6 are temporarily held in the RAM in the 
storage unit 22. In step S8, a counter (not shown) is in- 
cremented by one. In step S9, the count value of the 
counter is checked. If the count value has reached "N 
(N: positive integer)", the flow advances to step S10. If 
the count value has not reached N, the flow returns to 
step S2 (to wait for the next interrupt signal from the tim- 
er 39). In step S10, the count value of the counter is 
cleared. 

[0033] In step S11 , the packet shown in FIG. 4 is pre- 
pared. The addresses of the portable terminal 1 and the 
host terminal 3 are set as a transmission source address 
and a transmission destination address, respectively. 
As application identification information and a com- 
mand, an "action analysis program" and an "action anal- 
ysis command" are set. As position information, time in- 
formation, and sound information, the pieces of informa- 
tion acquired in steps S3, S4, and S6 are read out from 
the storage unit 22 and stored in the packet. The position 
information, time information, and sound information to 
be stored are data acquired N times. In step S12, the 



packet prepared in step S11 is output by radio. The 
packet is transferred to the host terminal 3 in accord- 
ance with the transmission destination address set in 
the header portion. 

5 [0034] In the above embodiment, all the acquired data 
corresponding to N cycles are transferred from the port- 
able terminal 1 to the hostterminal 3 to reduce the trans- 
mission cost. However, the data may be transferred 
when the acquired data reaches a predetermined ca- 

10 pacity. Alternatively, position information, time informa- 
tion, or sound information may be transferred to the host 
terminal 3 every time the information is acquired. In the 
above embodiment, the flow chart shown in FIG. 5 is 
autonomously executed by the portable terminal 1 . Al- 

15 ternatively, the processing of transmitting the packet to 
the host side may be executed in accordance with a 
starting instruction which is regularly transmitted from 
the host terminal 3. 

[0035] FIG. 6 is a block diagram of the host terminal 
20 3. A storage unit 51 is constituted by a semiconductor 
memory, a magnetic recording medium, or an optical re- 
cording medium and stores a program, data, and the 
like. The storage unit 51 may be permanently incorpo- 
rated or detachably mounted in the host terminal 3. 
25 [0036] A recording medium driver 52 reads out data 
stored in a portable recording medium (including a sem- 
iconductor memory, a magnetic disk, an optical disk, 
and a magnetooptical disk) 53 or writes data in the port- 
able recording medium 53. A communication control 
30 unit 54 controls data transmission/reception to/from the 
network. Packet transmission/reception to/from each 
portable terminal is also controlled by the communica- 
tion control unit 54. 

[0037] A CPU 55 loads the program from the storage 
35 unit 51 or the portable recording medium 53 and exe- 
cutes the program. The program and data recorded in 
the storage unit 51 may be written from the portable re- 
cording medium 53 or received from another device on 
the network through the communication line or the like 
40 and recorded. The CPU 55 may use a program and data 
stored in another storage unit arranged on the network 
through the communication line or the like. 
[0038] FIG. 7 is a flow chart for explaining processing 
in the host terminal 3. In this example, a packet sent 
45 from the portable terminal 1 (packet prepared with 
processing of the flow chart shown in FIG. 5) is received 
to analyze the action of the user who is carrying the port- 
able terminal 1 . 

[0039] In step S21 , the transmission source address 
50 stored in the header portion of the received packet is 
checked to recognize the transmission terminal. In this 
case, the transmission terminal is assumed to be the 
portable terminal 1 . The application identification infor- 
mation and the command are checked. In this case, as- 
55 sume that an "action analysis program" and an "action 
analysis command" are set. 

[0040] In step S22, position information and time in- 
formation, which are stored in the data portion of the 
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received packet, are extracted to recognize the position 
(Xj,Vj) of the portable terminal 1 at time Tj. In step S23, 
the moving direction and moving speed of the portable 
terminal 1 from time T M to time Tj are calculated. 
[0041] In step S24, the calculation result obtained in 
step S23 is used to estimate the moving means (walk- 
ing, train, motor vehicle, stop, •••) of the user who is car- 
rying the portable terminal 1 . More specifically, the po- 
sition of the user who is carrying the portable terminal 1 
at a certain time point, and if he/she is moving, the mov- 
ing means are estimated. In this processing of estimat- 
ing the moving means, sound information stored in the 
data portion of the received packet is used, as needed. 
In step S25, the estimation result obtained in step S24 
is stored in the personal action file of the user who is 
carrying the portable terminal 1 . 
[0042] The operation of the flow chart shown in FIG. 
7 will be described below in more detail. A case wherein 
the user who was carrying the portableterminal 1 moved 
from station A to station B by A railway, as shown in FIG. 

8, will be described. 

[0043] Upon receiving an action recording start com- 
mand from a key input means (not shown) of the porta- 
ble terminal 1 , or the host terminal 3, the portable termi- 
nal 1 executes the processing of the flow chart shown 
in FIG. 5 and detects the output from the GPS sensor 
14 at time T 0 , T-j, T 2 , T 10 . The detected pieces of 
position information correspond to position data P 0 , 
p 2> p io- ln detecting the position information, the 
portableterminal 1 fetches sound information acquired 
through the microphone 12. For example, it is estimated 
that, in a station, various types of noise are detected, 
and in a train, sounds unique to the train are detected. 
The portable terminal 1 transfers the detected position 
information, time information, and sound information to 
the host terminal 3. Since the data detected by the GPS 
sensor 1 4 have errors, points designated by the position 
information (position data P 0 , P^ P 2 , — , P-iq) do not a, ~ 
ways match the line. 

[0044] Upon receiving the information transferred 
from the portable terminal 1, the host terminal 3 exe- 
cutes the processing of the flow chart shown in FIG. 7 
to analyze the moving route of the user who is carrying 
the portableterminal 1 . Forthe purpose of analyzing the 
route, the host terminal 3 has map data as shown in FIG. 

9. FIG. 9 shows part of the position information of the 
line of A railway (position information of the line between 
station A and station B) as an example. 

[0045] As shown in FIG. 9, pieces of information rep- 
resenting the positions of stations (in this case, station 
A and station B) are stored. The position information of 
the line is stored as approximate curves of the line. In 
this example, the line between station A and station B 
is divided into four sections, and an approximate curve 
equation is defined for each section. 
[0046] The host terminal 3 also stores map data as- 
sociated with all railways. Not only data associated with 
railways but also data associated with roads are stored 



in the host terminal 3. These map data are stored in, e. 
g., the storage unit 51 and loaded in the memory 56 as 
a reference, as needed. 

[0047] FIG. 10 is a flow chart (1) for explaining 
5 processing of estimating the action of the user who is 
carrying the portable terminal 1 . This processing corre- 
sponds to steps S23 and S24 in FIG. 7. 
[0048] In step S31 , the average moving speed of the 
user who is carrying the portable terminal 1 is calculat- 
10 ed. More specifically, the average moving speed of the 
portable terminal 1 from time Tj.., to time Tj is calculated 
according to the following formula. At this time, the mov- 
ing direction is simultaneously calculated: 

15 

J(x r x L J 2 + {y r y f _J 2 
IV ^| 

20 [0049] In step S32, it is checked whether the speed 
calculated in step S31 is 1 km/h or less. If YES in step 
S32, it is estimated in step S33 that the user is "stop- 
ping". If NO in step S32, the flow advances to step S34. 
[0050] In step S34, it is checked whether the speed 
25 calculated in step S31 is 6 km/h or less. If YES in step 
S34, it is estimated in step S35 thatthe user is "walking". 
If NO in step S34, the flow advances to step S36. 
[0051] In step S36, it is checked whether the moving 
locus of the user who is carrying the portable terminal 1 
30 is similar to the railway line pattern stored as map data. 
In this case, distances from the points designated by po- 
sition data P 0 , P 1( P 2 , P 10 to the curves represented 
by the curve equation representing the railway line are 
calculated by, e.g. , the method of least squares, and de- 
35 termination is made on the basis of whether each cal- 
culated value is equal to or smaller than a predeter- 
mined value. Alternatively, determination is made on the 
basis of the similarity between a locus drawn by at least 
two position data and a curve pattern representing the 
40 railway line. Determination in this step is performed us- 
ing a known technique, and a detailed description there- 
of will be omitted. 

[0052] If the moving locus of the user who is carrying 
the portableterminal 1 is similar to the line pattern, it is 
45 estimated in step S37 that the user is "moving by train". 
If the moving locus is not similar to the line pattern, it is 
estimated in step S38 that the user is "moving by motor 
vehicle (automobile or bus)". 

[0053] The estimation result obtained in this way is 
50 held in a predetermined area on the memory 56 as data 
of action (movement situation) of the user who is carry- 
ing the portable terminal 1 at a certain time point. The 
host terminal 3 sequentially stores the estimation result 
data at each time (time when the position information 
55 and the like are detected by the portable terminal 1). 
[0054] FIG. 11 is a flow chart (2) for explaining 
processing of estimating the action of the user who is 
carrying the portable terminal 1 . This processing corre- 
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sponds to step S24 in FIG. 7 and is executed parallel to 
the processing shown in FIG. 10. 
[0055] In step S41 , sound information stored in the 
packet transferred from the portable terminal 1 is ex- 
tracted. In step S42, the sound information is analyzed 
to recognize the characteristic features of the sound in- 
formation. In step S43, it is checked whether the sound 
information analyzed in step S42 includes unique 
sounds generated in a running train. If YES in step S43, 
it is estimated in step S44 that the user is "moving by 
train". If NO in step S43, the flow advances to step S45. 
[0056] In step S45, it is checked whether the sound 
information analyzed in step S42 includes unique 
sounds generated in a running motor vehicle or bus. If 
YES in step S45, it is estimated in step S46 that the user 
is "moving by motor vehicle". If NO in step S45, the 
sound information is discarded in this estimation 
processing. 

[0057] The host terminal 3 holds in advance a unique 
sound pattern generated in a running train and a unique 
sound pattern generated in a running automobile or bus. 
In step S43 or S45, the similarity between the sound in- 
formation extracted in step S41 and the held pattern is 
determined. 

[0058] The estimation result obtained by processing 
of the flow chart shown in FIG. 11 is used as information 
for increasing the likelihood ratio of the estimation result 
obtained by processing of the flow chart shown in FIG. 
10. 

[0059] FIG. 12 is a flow chart (3) for explaining 
processing of estimating the action of the user who is 
carrying the portable terminal 1. In this processing, a 
plurality of estimation results are obtained by processing 
of the flow charts shown in FIGS. 10 and 11, and the 
action of the user who is carrying the portable terminal 
1 is estimated at a higher likelihood ratio on the basis of 
these pieces of information. 

[0060] In step S51 , M estimation results obtained by 
processing of the flow charts shown in FIGS. 1 0 and 1 1 
are extracted. When M = 5, and the action at times Tj is 
to be estimated, estimation results at time Tj_ 2 , T M , Tj, 
T j+1 , and T k2 are extracted. 

[0061] lnstepS52, it is checked whether all the M es- 
timation results extracted in step S51 are in the same 
state. If YES In step S52, the estimation results are re- 
garded as an estimation result having a higher likelihood 
ratio. The flow advances to step S61 to hold the result 
togetherwith the position information and thetime infor- 
mation. Assume that all the estimation results obtained 
by processing of the flow chart shown in FIG. 1 0 at times 
Tj_ 2 , Tj_i, Tj, T j+1 , and T j+2 are "stop", the host terminal 
3 estimates that the user who is carrying the portable 
terminal 1 is stopping at the position represented by the 
position information at that time, and stores the estima- 
tion result in the memory 56 or the storage unit 51 . 
[0062] If it is determined in step S52 that the estima- 
tion results are different it is checked in step S54 wheth- 
er the M estimation results include only "stop" and "walk- 



ing". If YES in step S54, it is estimated in step S55 that 
the user who is carrying the portable terminal 1 is "walk- 
ing". The flow advances to step S61 to hold the estima- 
tion result together with the position information and the 
5 time information. 

[0063] If, in step S54, the estimation results include 
estimation results other than "stop" and "walking", it is 
checked in step S56 whether a predetermined number 
or more of estimation results "moving by train" are in- 
fo eluded. If YES in step S56, it is estimated in step S57 
that the user who is carrying the portable terminal 1 is 
"moving by train". The flow advances to step S61 to hold 
the estimation result together with the position informa- 
tion and the time information. 
15 [0064] If NO in step S56, it is checked in step S58 
whether "moving by motor vehicle (automobile or bus)" 
is included. If YES in step S58, it is estimated in step 
S59 that the user who is carrying the portable terminal 
1 is "moving by motor vehicle". The flow advances to 
20 step S61 to hold the estimation result together with the 
position information and the time information. If NO in 
step S58, error processing is executed in step S60. 
[0065] With the above procedure, estimation results 
as shown in FIG. 13 are obtained. The algorithm for es- 
25 timating the action of the user who is carrying the port- 
able terminal 1 is not limited to the above algorithm, and 
another method may be used. 

[0066] A procedure of preparing an action record ta- 
ble as shown in FIG. 14 will be described. FIG. 15 is a 
30 flow chart of processing of preparing the action record 
table of the user who is carrying the portable terminal 1 . 
[0067] In step S71 , "stop" is extracted from the esti- 
mation results shown in FIG. 13, and the start time and 
end time are checked. The position information is also 
35 extracted. In step S72, it is checked whether the stop 
position extracted in step S71 is a position registered in 
advance. For this determination, the host terminal 3 re- 
fers to a table shown in FIG. 16. The table shown in FIG. 
1 6 stores various names on the map and corresponding 
40 position information. Railway stations and other public 
facilities are registered in advance. In addition, the user 
can register a desired location. In this embodiment, 
"head office", "business office", "Mr. K's house", — are 
registered. 

45 [0068] If YES in step S72, the name of the registration 
position is extracted in step S73. If NO in step S72, the 
region name of the position (e.g., xx Prefecture xx City 
xx) is extracted in step S74. Note that the host terminal 
3 has a table storing region names and corresponding 
50 position information. 

[0069] In step S75, the registration position name ex- 
tracted in step S73 or the region name extracted in step 
S74 is written for the time zone of "stop" recognized in 
step S71 . Assume that the user who was carrying the 
55 portable terminal 1 was in the head office before 1 4:1 0. 
In this case, the position information detected by the 
portable terminal 1 before 14:10 must be equal or ap- 
proximate to position data (x 50l! y 501 ) registered in the 
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table shown in FIG. 16. The position information detect- 
ed by the portable terminal 1 is transferred to the host 
terminal 3 and stored in the table shown in FIG. 13. In 
processing in steps S72 through S74, the host terminal 
3 recognizes that the user who was carrying the portable 
terminal was in the head office before 14:10 because 
the position information detected by the portable termi- 
nal 1 is equal or approximate to the position data regis- 
tered as the position of the head office. As a result, "head 
office" is written for the time zone before 14:10, as 
shown in FIG. 14. 

[0070] In step S76, the moving means (walking, train, 
automobile, or bus) represented by the above-de- 
scribed estimation result and the start time and end time 
of movement using the moving means are checked. As 
shown in FIG. 14, the moving means is written for each 
time zone. When a specific means of transportation is 
used, the means of transportation is written in step S77. 
Assume that it is estimated from the similarity to the rail- 
way line pattern stored as map data shown in FIG. 9 that 
the user who was carrying the portable terminal moved 
from station A to station B by A railway, "A railway" is 
written as a moving means, and region names "station 
A" and "station B" are written as a starting point and a 
terminal point, respectively. 

[0071] The action record table prepared in the above 
way is stored in a predetermined area in the storage unit 
51 of the host terminal 3. When the user who is carrying 
the portable terminal 1 is to display the action record 
table on the portable terminal 1 , a packet for requesting 
display of the action record table is sent from the porta- 
ble terminal 1 . The request packet has the structure 
shown in FIG. 4. The addresses of the portable terminal 
1 and the host terminal 3 are set as a transmission 
source address and a transmission destination address, 
respectively. An "action analysis program" is set as ap- 
plication identification information, and an "analysis re- 
sult request command" is set as a command. A date to 
be referred to is added as additional information of the 
command. The command and the additional information 
of the command are input by the user using, e.g., a pen 
input method from the LCD display unit 1 1 of the porta- 
ble terminal 1 . 

[0072] Upon receiving thecommand having the "anal- 
ysis result request command" from the portable terminal 
1 , the host terminal 3 interprets the command and ex- 
tracts the action record table of the user who is carrying 
the portable terminal 1 at the designated date. The ex- 
tracted action record table is stored in a packet and 
transferred to the portable terminal 1 . The portable ter- 
minal 1 extracts the action record table from the packet 
transferred from the host terminal 3 and displays it on 
the LCD display unit 11 . 

[0073] The processing programs executed by the 
host terminal 3, i.e., programs for realizing the functions 
of the flow charts shown in FIGS. 7, 10, 11, 12, and 15, 
and the program for interpreting a command transferred 
from the portable terminal 1 and processing the com- 



mand are stored in the storage unit 51 or the portable 
recording medium 53 in the form of program codes 
which can be read by the CPU 55. Alternatively, pro- 
grams stored in another device connected through the 
5 network are used. 

[0074] As described above, in the action analyzing 
system of this embodiment, position information and 
time information are detected by the portable terminal 1 
and transferred to the host terminal 3, and the action 
10 record of the user who is carrying the portable terminal 
1 is automatically prepared on the host side. For this 
purpose, the portable terminal 1 need have only a func- 
tion of detecting position information and time informa- 
tion and transferring them to the host terminal 3, a tune- 
's tion of requesting the host terminal 3 of an action record, 
and a function of displaying data downloaded from the 
host terminal 3. That is, the portable terminal 1 need 
neither store an enormous quantity of map data nor ex- 
ecute highly precise pattern recognition processing or 
20 various processing which require high-speed process- 
ing. For this reason, the portable terminal 1 can obtain 
an advanced action analysis result without requiring any 
large-capacity memory or high-performance processor 
[0075] In the above embodiment, position information 
25 and time information are detected by the portable termi- 
nal 1 at a predetermined timing. However, the present 
invention is not limited to this arrangement. Generally, 
the user of the movable terminal is not always moving 
and can be considered to stop at a certain position for 
30 most of time. If the user of the portable terminal stops 
at a certain position for a predetermined time or more, 
position information need not be detected every prede- 
termined time, and not all the position information need 
be supplied from the portable terminal 1 to the host ter- 
35 minal 3. 

[0076] FIG. 1 7 is a flow chart showing an operation of 
preparing a packet from data acquired by the portable 
terminal 1 and sending the packet. This processing pro- 
cedure is obtained by adding steps S81 through S83 to 
40 the flow chart shown in FIG. 5. 

[0077] In step S81 , it is checked whether the position 
information obtained in step S3 coincides with position 
information of one and two cycles before. If NO in step 
S81, the flow advances to step S7 to continue the 
45 processing in FIG. 5. If YES in step S81 , the position 
information, time information, and sound information at 
the preceding timing are discarded in step S82. In step 
S83, the counter which is to be incremented by one in 
step S8 is decremented by one. 
50 [0078] Processing of the flow chart shown in FIG. 1 7 
will be described in more detail. A case wherein the user 
who was carrying the movable terminal 1 was continu- 
ously present at position P 0 and time T 1 through time T 4 
(times detected in step S4) will be described. 
55 [0079] "Position P 0 " is detected by position detection 
at time T 1 and time T 2 , and these data are held in step 
S7. At time T 3 , "position P 0 " is detected again. In step 
S81 , the position data at time T 3 coincides with position 
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data of one (time T 2 ) and two (time T.,) cycles before. 
The flow advances to step S82 to discard the position 
information, time information, and sound information ac- 
quired at the preceding timing (timeT 2 ). Thereafter, the 
position data at time T 3 is held in step S7. As a result, 
only the pieces of information acquired at time T 1 and 
time T 3 are held. 

[0080] "Position P 0 " is detected at time T 4 again. 
Since, in step S81, position data at time T 4 coincides 
with position data of one (time T 3 ) and two (time T^ cy- 
cles before, the flow advances to step S82 to discard 
position information, time information, and sound infor- 
mation acquired at the preceding timing (timeT 3 ). At this 
time point, the information at time T 2 have been discard- 
ed, and time T 1 corresponds-to the timing of "two cycles 
before". Thereafter, the position data at time T 4 is held 
in step S7. As a result, only the pieces of information 
acquired at time T 1 and time T 4 are held. 
[0081] As described above, when the user who was 
carrying the movable terminal 1 continuously stayed at 
a certain position for a predetermined time or more, only 
position information, time information, and sound infor- 
mation at the start and end of "stop" are held and trans- 
ferred to the host terminal 3. With this arrangement, 
transfer of redundant information (in the above example, 
information acquired at time T 2 and time T 3 ) can be re- 
duced. 

[0082] In the above embodiment, the GPS sensor is 
used as a means for detecting the position information 
of the portable terminal 1 . However, the present inven- 
tion is not limited to this. For a mobile communication 
network whose cell range is narrow, a cell which is cur- 
rently managing the portable terminal may be used as 
position information. 

[0083] I n the above embodiment, the action record ta- 
ble has the form of a timing chart as shown in FIG. 14. 
However, the present invention is not limited to this. For 
example, an illustration as shown in FIG. 18 may be 
used. 

[0084] In the above embodiment, position information 
or time information is detected at a predetermined time 
interval. However, such information need not always be 
detected at a predetermined time interval. Information 
may be appropriately sampled a sufficient number of 
times for action analysis. 

[0085] In the above embodiment, the action of the us- 
er who is carrying the movable terminal is analyzed. 
However, the arrangement is not limited to the applica- 
tion purpose of detecting the human action. The ar- 
rangement can also be applied to survey the action pat- 
tern of an animal or check the delivery state of goods. 



Claims 

1. An action analyzing/recording system comprising: 
a portable terminal (1) having a detector (14) 



for detecting a position of the portable terminal 
(1 ) to generate position data of the portable ter- 
minal (1), 

5 a host device (3) having a data processor (55) 

for processing the position data transmitted 
from the portable terminal (1), and 

a network (2) connecting the portable terminal 
10 (1) and the host device (3), 

characterized in that 

said data processor (55) comprises means for an- 
alyzing the position data to obtain an action record 
15 which indicates when and where a user of the port- 
able terminal was, whether the user used transpor- 
tation means to move from a location to another lo- 
cation, and which transportation means the user 
used if the user used the transportation means. 

20 

2. An action analyzing/recording system according to 
claim 1 , wherein 

said system comprises a plurality of portable termi- 
nals (1 ) which transmit the position data with an own 

25 identification code, 

said analyzing means obtains the action records for 
the respective portable terminals (1), and 
said data processor (55) comprises means (54) for 
transmitting the action records to the corresponding 

30 portable terminals (1). 

3. An action analyzing/recording system according to 
claim 1 or 2, wherein said portable terminal detects 
positions of the portable terminal (1 ) plural times to 

35 generate position data with different timings, com- 
prises a memory (22) for storing plural position data, 
and transmits the plural position data when a re- 
maining capacity of the memory (22) becomes a 
predetermined level. 

40 

4. An action analyzing/recording system according to 
any of claims 1 to 3, wherein said data processor 
(55) comprises means (51 ) for storing map informa- 
tion representing a name of the transportation 

45 means including a railway or bus line, and said an- 
alyzing means detects a moving speed of the user 
and obtains the action record by referring to the map 
information based on the moving speed. 

50 5. An action analyzing/recording system according to 
claim 4, wherein said portable terminal (1) compris- 
es means (41 , 1 5) fortransmitting to the host device 
(3) the position data of the portable terminal (1 ) and 
time information of timings when the position data 
55 are obtained. 

6. An action analyzing/recording system according to 
any of claims 1 to 5, wherein said portable terminal 
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(1) comprises means (12) for detecting ambient 
sound to transmit sound data to the host device (2), 
and 

said analyzing means analyzes the sound data to 
determinewherethe userwas and whetherthe user 
walked on foot or used the transportation means to 
move. 

7. An action analyzing/recording system according to 
any of claims 1 to 6, wherein said data processor 
(55) comprises means (54) for transmitting the ac- 
tion record to the portable terminal (1). 



Patentanspruche 

1. Aktions-AnalyseVAufzeichnungs-System, umfas- 
send: 

ein tragbares Endgerat (1) mit einem Detektor 
(1 4) zum Erfassen einer Position des tragbaren 
Endgerates (1), um Positionsdaten des tragba- 
ren Endgerates (1) zu erzeugen, 

einen Zentralrechner (3) mit einer Datenverar- 
beitungseinrichtung (55) zur Verarbeitung der 
Positionsdaten, die von dem tragbaren Endge- 
rat (1) ubertragen werden, und 

ein Netzwerk (2), das das tragbare Endgerat (1 ) 
und den Zentralrechner (3) verbindet, 

dadurch gekennzeichnet, dass 

die Datenverarbeitungseinrichtung (55) eine Ein- 
richtung zur Analyse der Positionsdaten umfasst, 
um eine Aktionsaufzeichnung zu erhalten, die an- 
gibt, wann und wo ein Benutzer des tragbaren End- 
gerates war, ob der Benutzer eine Transporteinrich- 
tung benutzt hat, um sich von einem Ort zu einem 
anderen Ort zu bewegen, und welche Transportein- 
richtung der Benutzer verwendet hat, wenn der Be- 
nutzer die Transporteinrichtung verwendet hat. 

2. Aktions-AnalyseVAufzeichnungs-System gemaB 
Anspruch 1 , wobei 

das System eine Mehrzahl tragbarer Endgerate (1 ) 

umfasst, die die Positionsdaten mit einem eigenen 

Kennzeichnungscode ubertragen, 

die Analyseeinrichtung die Aktionsaufzeichnungen 

fur die jeweiligen tragbaren Endgerate (1) erhalt, 

und 

die Datenverarbeitungseinrichtung (55) eine Ein- 
richtung (54) zur Ubertragung der Aktionsaufzeich- 
nungen zu den entsprechenden tragbaren Endge- 
rate n (1) umfasst. 

3. Aktions-Analyse-/Aufzeichnungs-System gemaB 
Anspruch 1 oder 2, wobei das tragbare Endgerat 



mehrfach die Positionen des tragbaren Endgerates 
(1) erfasst um Positionsdaten zu unterschiedlichen 
Zeitpunkten zu erzeugen, einen Speicher (22) zur 
Speicherung der Mehrzahl von Positionsdaten um- 
5 fasst und die Mehrzahl der Positionsdaten iiber- 
tragt, wenn die verbleibende Speicherkapazitat 
(22) eine vorbestimmte Stufe erreicht. 

4. Aktions-Analyse-ZAufzeichnungs-System gemaB 
10 einem der Anspruche 1 bis 3, wobei die Datenver- 
arbeitungseinrichtung (55) eine Einrichtung (51) zur 
Speicherung von Karten information umfasst, die ei- 
nen Namen der Transporteinrichtung einschlieBlich 
einer Eisenbahn- oder Buslinie darstellt, und die 

15 Analyseeinrichtung eine Fortbewegungsgeschwin- 
digkeit des Benutzers erfasst und die Aktionsauf- 
zeichnung unter Bezugnahme auf die Karteninfor- 
mation basierend auf der Fortbewegungsgeschwin- 
digkeit erhalt. 

20 

5. Aktions-AnalyseVAufzeichnungs-System gemaB 
Anspruch 4, wobei das tragbare Endgerat (1) eine 
Einrichtung (41 , 15) zur Ubertragung der Positions- 
daten des tragbaren Endgerates (1) und von Zeit- 

25 informationen der Zeitpunkte, zu denen die Positi- 
onsdaten erhalten werden, zu dem Zentralrechner 
(3) umfasst. 

6. Aktions-Analyse-/Aufzeichnungs-System gemaB 
30 einem der Anspruche 1 bis 5, wobei das tragbare 

Endgerat (1) eine Einrichtung (12) zur Erfassung 
von Umgebungsgerauschen und zur Ubertragung 
der Tondaten zu dem Zentralrechner (2) umfasst, 
und 

35 die Analyseeinrichtung die Tondaten analysiert, um 
festzustellen, wo der Benutzer war, und ob der Be- 
nutzer sich zur Fortbewegung zu FuB oder unter 
Verwendung der Transporteinrichtung bewegt hat. 

40 7. Aktions-Analyse-/Aufzeichnungs-System gemaB 
einem der Anspruche 1 bis 6, wobei die Datenver- 
arbeitungseinrichtung (55) eine Einrichtung (54) zur 
Ubertragung der Aktionsaufzeichnung zu dem trag- 
baren Endgerat (1) umfasst. 

45 

Revendications 

1. Systeme d'analyse/enregistrement d'action 
50 comprenant : 

un terminal portable (1) quicomporte un detec- 
teur (1 4) pour detecter une position du terminal 
portable (1 ) afin de generer des donnees de po- 
55 sition du terminal portable (1) ; 

un dispositif note (3) qui comporte un proces- 
seur de donnees (55) pourtraiter les donnees 
de position qui sonttransmises depuis le termi- 
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nal portable (1) ; et 

un reseau (2) qui connecte le terminal portable 
(1) et le dispositif hote (3), 

caracterise en ce que : 5 

ledit processeur de donnees (55) comprend un 
moyen pour analyser les donnees de position 
afin d'obtenir un enregistrement d'action qui in- 
diqueou un utilisateurdu terminal portable eta it 10 
et quand, si oui ou non I'utilisateur a utilise un 
moyen de transport pour se deplacer depuis un 
endroit jusqu'a un autre endroit et quel moyen 
de transport I'utilisateur a utilise si I'utilisateur 
a utilise le moyen de transport. is 



de cadencements lorsque les donnees de position 
sont obtenues. 

6. Systeme d'analyse/enregistrement d'action selon 
Tune quelconque des revendications 1 a 5, dans 
lequel : 

ledit terminal portable (1) comprend un moyen 
(1 2) pour detecter un son ambiant afin de trans- 
mettre des donnees de son au dispositif hote 
(3) ; et 

ledit moyen d'analyse analyse les donnees de 
son afin de determiner ou I'utilisateur etait et si 
oui ou non I'utilisateur a marche a pieds ou a 
utilise le moyen de transport pour se deplacer. 



2. Systeme d'analyse/enregistrement d'action selon 
la revendication 1 , dans lequel : 

ledit systeme comprend une pluralite de termi- 20 
naux portables (1) qui transmettent les don- 
nees de position avec un code d'identification 
prop re ; 

ledit moyen d'analyse obtient les enregistre- 
ments d'action pour les terminaux portables 25 
respectifs (1) ; et 

ledit processeur de donnees (55) comprend un 
moyen (54) pour transmettre les enregistre- 
ments d'action aux terminaux portables corres- 
pondents (1). 30 



7. Systeme d'analyse/enregistrement d'action selon 
I'une quelconque des revendications 1 a 6, dans le- 
quel ledit processeur de donnees (55) comprend un 
moyen (54) pour transmettre I'enregistrement d'ac- 
tion au terminal portable (1 ). 



3. Systeme d'analyse/enregistrement d'action selon 
la revendication 1 ou 2, dans lequel ledit terminal 
portable detecte des positions du terminal portable 
(1) plusieurs fois afin de generer des donnees de 35 
position avec differents cadencements, il comprend 
une memoire (22) pour stocker les donnees de plu- 
sieurs positions et il transmet les donnees de plu- 
sieurs positions lorsqu'une capacite restante de la 
memoire (22) devient egale a un niveau predeter- 40 
mine. 



4. Systeme d'analyse/enregistrement d'action selon 
I'une quelconque des revendications 1 a 3, dans le- 
quel ledit processeur de donnees (55) comprend un 45 
moyen (51) pour stocker une information de carte 
qui represente un nom du moyen de transport in- 
cluant une voie ferree ou une ligne de bus, et ledit 
moyen d'analyse detecte une Vitesse de deplace- 
ment de I'utilisateur et obtient I'enregistrement d'ac- 50 
tion par reference a reformation de carte sur la ba- 
se de la Vitesse de deplacement. 



5. Systeme d'analyse/enregistrement d'action selon 

la revendication 4, dans lequel ledit terminal porta- 55 
ble (1 ) comprend un moyen (41 , 1 5) pour transmet- 
tre au dispositif hote (3) les donnees de position du 
terminal portable (1) et une information temporelle 
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